//a ;■ s s 

eft- 

3 6 9 7V&> 

fi /7 


Evaluation of expressions involving higher order 

derivations 

Robert Grossman* 

University of Illinois at Chicago 

May, 1990 


Abstract 

The local geometric properties of a nonlinear control system defined 
by vector fields E\, . . Em are determined by the algebraic properties 
of the iterated Lie brackets of the Ej ’s. Let R = C°°(R. N ) and let 


D = 


d 

dx„' 




Assume that the vector fields Ej are written in terms of the basis 
with coefficients from R: 


N 

Ej = aj* Dp, where aj* E R, 

?=i 


In general, when expressions involving the noncommuting Ej'a are 
written in terms of the commuting D^a, there is cancellation. In this 
paper we examine the problem of rewriting expressions involving the 
Ej ’a in terms of the D^a in such a way as to handle efficiently any 
cancellation occurring due to the commuting of the D^s. Roughly 
speaking, we introduce a data structure which allows us to organize 
the computation to take advantage of the symmetries in the expression 
and reduce the operation count. 


1 Introduction 

Given two vector fields E\ and E2 on R^, let [E2, E\] = E^E\ — E\ Ej 
denote their Lie bracket. Since at least the late 1960’s, the local geometric 
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properties of the nonlinear control system 


±(0 = E *(o) = *°eR" 

have been studied by the algebraic properties of the iterated Lie brackets 

£•*]•••]> 1 < *1, ••■»«*< M 


of the vector fields E\ f . . ., Em and the series and algebras they generate. 
See, for example, [ 2 ] and [ 3 ]. Here t — ► ui(t), . . t — ► u*f(*) are controls. 

This paper is concerned with algorithms for the explicit symbolic com- 
putation of iterated Lie brackets and series built from them. In practice, the 
vector fields Ej will be written in terms of a basis D\ } . .., for vector 
fields on RA. For example, if we let R = C°°(R^) and use the basis 



i = l } ... 


we can express any smooth vector field on R^ as a sum 
N 

Ej = £ where a? € 1 < j < M . 

To rewrite the expression 


p — £3 E2 E\ — £3 £1 E2 — £2 £1 £3 + £1 £2 £3 


( 1 ) 

( 2 ) 


in terms of the basis D M by naively substituting the sum (1) for each occur- 
rence of Ej yields 24 jV 3 terms. Because of the symmetry of p } the resulting 
expression simplifies to yield 6AT 3 terms. In § 5 of this paper, we give an 
algorithm which computes precisely the 6 N 3 in the simplified expression, 
without the necessity of computing the other 18 N 3 terms. 

The basic idea is to map expressions p involving the vector fields Ej 
into expressions involving labeled trees. A multiplication on trees is de- 
fined corresponding to the composition of vector fields. There is also a map 
from labeled trees into expressions involving the vector fields D^. The com- 
position of these two maps corresponds to the substitution (1), but does 
not involve the computation of terms which cancel in the end due to the 
symmetry of the expression p. 
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The paper is organized as follows: § 2 contains some algebraic prelim- 
inaries and a statement of the theorem. Section 3 contains preliminaries 
about trees, including the definition of the multiplication. Section 4 defines 
the map from expressions p to trees and § 5 defines the map from trees to 
expressions involving the vector fields D Section 6 contains the proof the 
main theorem. 

This is a revision of the Technical Report [1], 
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2 Derivations 

The example above involving the expression (2) concerned vector fields with 
coefficients in the ring R of C°° functions on R^. This paper considers the 
vector fields Ej to be derivations of the ring R and considers expressions p 
to be elements in the free associative algebra generated by the symbols E \ , 
. . . , Em- 

More generally, let R be a commutative ring with a unit element. A 
derivation of R is a map D of R to itself satisfying 

D(a + b) = D(a)+D(b) 

D(ab) = aD(b) + bD{a) for all a, b € R. 

% 

Let D\ , . . . , Dn be commuting derivations of R\ that is 

DiDja = DjDia , for all a € R, 1 < i, j < N. 

Suppose that we are also given derivations E\ t . . . } Em of R which can be 
expressed as R-linear combinations of the former derivations; that is 

N 

Ej = ^2 a j £#•* where a** 6 R, 1 < j < M . 

M=1 

Let K denote the subring of constants of R 

D\a = 0, , D^a = 0, for all a G K , 


-if - i . . 
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and let 


K<E u ...,E m > 

denote the free associative tf-algebra in the symbols Ex } ... } Em- Note 
that elements p of the free associative algebra may be thought of as a higher 
order derivation of R generated by the E \ , . . . , Em . Let Diff(Di, . . . , D^ \ R) 
denote the space of formal linear differential operators with coefficients from 
R\ that is Diff(Di, . . . , D^\ /Z) consists of all formal expressions 

N N 

41 = 1 41 , 43=1 

JV 

+ • • • + ^ <*41 ,..., 4 * Dp k * * * , 

41 i » m 4*=1 

where a Ml , t/i * € R • We say that L € Diff(Di, . . . , Djg\ R) 

and V G Diff(Di , . . . , Ds \ R) agree if 

L(a) = //(a), for all a € 

Fix an element p £ Em> and suppose that p contains / terms, 

each of which is homogeneous of degree m. If we make the substitution 

JV 

Ej = ^2 a** Dp, where a ? € iZ, 

4=1 

in the expression p, and use the fact that D\ t . . . , Djy are derivations of 
iZ, we get a differential operator in Diff(Di, . . . , Djg\ /Z). It is easy to see 
that before any cancellation this differential operator contains lm\ N m terms 
involving D \ , . . . , Djv. 

In this paper we ask whether we can find an operator L in Diff(Z5j , 

. . Djy] R) which agrees with this differential operator but requires fewer 
operations involving the derivations D \ } . . . , Dn. We show that such an L 
does indeed exist in case p has a certain symmetry, which we call a symmetry 
decomposition. In § 6 we give the exact definitions and prove the following 
theorem. 

Theorem 2.1 Fix an expression p € K<E \^ . . >Em> wAicA is homoge- 
neous of degree m. Let x(p) € DifffDu . . . , Djg\ R) denote the differential 
operator obtained by the substitution 
N 

Ej = 53 a j D 4» where 1 < J < Af. 

4=1 
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Expression p 

Ix(p)I 

\L\ 

1x0)1 - \L\ 

i?2 E\ — E\ E 2 

4N* 1 

2N* 

~2 N 1 

£*3^2 + E 3 E 1 E 2 

12N 3 

6N 3 

6N 3 

E 3 E 2 E x — E 3 E\ E? — E 2 E 1 E 3 + E\ E 2 E 3 

24N 3 

6JV 3 

\8N 3 


Table 1: Some expressions and the resulting cancellations. 


Assume that p has a symmetry decomposition . Then there exists a differ- 
ential operator L such that (i) L involves cN m fewer occurrences of terms 
containing D\j. . . } Djg than does the naive computation of x(p)/ 00 
higher order derivations x(p) and L agree. Here c is a constant depending 
upon the symmetry decomposition. 

We end this section with two remarks. First, it is important to note that 
the algorithm we give in 5 6 does not require the explicit identification of 
the symmetry decomposition; rather, if such a symmetry decomposition is 
present the differential operator L produced by the algorithm will contain 
fewer terms than the differential operator x(p)- 

Second, it is quite common for expressions in the Ej's to involve cancella- 
tion. Table 2 details the reduction in the number of terms for three different 
expressions. The last column lists the number of terms which either cancel 
or combine: these terms need not be computed. We hope to return in a 
later paper to the classification of those expressions in E\ y . . . , Em which 
result in cancellation or combination when they are written in terms of the 
In this paper we simply point out that Lie brackets are ex- 
pessions of this type and that is easy to write down other such expressions. 


3 Trees 

In this section we describe a data structure that is useful for computations 
involving higher order derivations. By a tree we always mean a rooted, finite 
tree. We define the set H m of heap-ordered trees or heaps on m nodes to be 
the set of all trees h consisting of m + 1 nodes together with a key map 

k : nodes h — ► {0,1,..., m} 


satisfying 




1. k is bijective; 

2. v a child of w implies k(v) > k(u>), where t >,w £ nodes h. 

From now on we use the map k to identify a node with its key j £ {0, . . . , m} . 

The following definition and notation will be used throughout the paper. 
Let Ei, . . . , Em be M arbitrary symbols. Given a heap h € H m , let 

i • • ■ i ^1m) 

denote the labeled heap where the node j carries the label 

E^ £ {E\,...,Em}, 1 <j<m. 

Denote the set of all such labeled heaps by 

LH m = LH m (Ei ,. . . , Em) 

and put 

LH = LH (Ei,... t E m )= (J LH m (Ei,...,E M ). 

m> 0 

We say that h £ LH(E \ } . . . ? Em) is homogeneous of degree m in case h £ 
LH m (E \ y . . . ,2?jv/). 

We now describe a multiplication on labeled heaps. Let 

0(LH{E u ...,E m )) 

denote the vector space over K whose basis consists of labeled heaps h in 
LH(E \ , . . . , Em)- The product 

h 2 h 1 eO{LH(E li .'.,E M )) 

of two labeled heaps 

- ■ ■ * ^ LH mx (E \ , . . . i Em) 

^ 2(^1 > • • • 1 ^ m3 ) G LH m2 {Eij . . . , Em) 
is defined as follows: 

Step 1. Recall that each node of heap h 2 has a name 0, 1, ...» m 2 and each 
node of heap h\ has a name 0, 1, . . . , mi. Rename the names of the 
nodes of heap 2 as follows: 

old name 1 2 • ■ • m 2 

new name mj + 1 mi + 2 • ■ • mi + 

old label E m E ^ • • • E^ 

new label E m E^ ■ ■ • E ^ 

Keep the names and labels of Ai the same. 
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Step 2. Delete the root of hi- This produces several subtrees ti , . . . , tj with 
roots ci , . . . , C|. Write this as 

deleteroot /»2 = {< 1 , • • • ,</}• 


Step 3. Choose l nodes of hi, allowing repetition; that is, choose ni, 
nj € (nodes hi). 

Step 4. Form the new tree obtained by linking each root Cj to the node nj, 
for j = 1, . . . , This is not merely a tree but also a heap, denoted 

link(ti,...,ti;n 1 ,...,n J ). 


Step 5. Sum over all possible choices of nodes ni,...,nj in Step 3. This 
defines the product of the labeled heaps h\ and h?: 

/» 2 -hj= 0 link(fi,...,</;ni,...,nj), 

ni,. . . ,n;€(nodes hi) 1 

where deleteroot /»2 = {*i > • • • i '*/}• 

Step 6. Finally, extend the product to all of 0(LH(Ei, . . . ,Em)) by K- 
lineau'ity. 

We call the space 0{LH{E \, . . . ,Em)) the space of orchards. We con- 
clude this section by showing that the space of orchards is a AT-algebra. 


Lemma 3.1 The space of orchards 0(LH(Ei, . . . , Em)) is a K -algebra. 


Proof. We need only show that the product of labeled heaps is associative. 
Recall that a heap is characterized by a table listing the parents of each 


node. For example 


node parent 

0 0 

1 0 

2 0 

3 1 

4 3 

5 2 


is an element of H$. Notice that one of the nodes (the root) does not have 
a parent: this is denoted with an 0. 
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node 

parent 

0 

0 

1 

* 

m x 

* 

(root ) 

0 

mi + 1 

* 

mi + m 2 

* 

(root ) 

0 

mi + m 2 + 1 

* 

mi + m 2 + m 3 

* 


Figure 1: The labeled heaps in A 3 • A 3 • h\. 

Let hj G H mjJ for j = 1,2,3. The product 

A3 * (A2 • Ai) 

contains the heaps of Figure 1. Figure 1 uses a number of conventions which 
we now describe. We use a dashed line to indicate which heaps the nodes 
belonged to before the product was formed. We say that all the nodes above 
the first dashed line belong to the first layer; that all the nodes between the 
two dashed lines belong to the second layer, etc. For example all nodes 
from the third layer were originally elements of A3. If a node is enclosed in 
parentheses, that indicates that it was a node of one of the heaps comprising 
the product, but was deleted during the formation of the product. As already 
remarked, a 0 indicates that a node has no parent. Finally a * is used to 
indicate the name of any node higher up in the table. For example the first 
table says that node 3 is the parent of node 4. With this notation we could 
replace the 3 with a * f since 3 occurs above 4 in the first column of the table. 
We will show that 

A 3 • (A 2 • hi) = (A 3 * h 2 ) * Af. 

Given a term A G A 3 « (h 2 • Ai), we will show that A G (A 3 • h 2 ) • Ai also. 
Notice that the table consists of three layers, corresponding to the three 
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heaps and multiplication of heaps simply consists of replacing 

any * which is a 0 with the names of all the nodes in the layer(s) above it in 
the table and forming the corresponding heaps. For example, in computing 
/*3 * (/>2 • hi), the *’s in h$ which are 0 are replaced with the names of nodes 
in the two layers above. If the node is in the segment immediately above 
(corresponding to /12), then it is clear that such a heap is formed when 
computing ( h 3 • /12) * h\. On the other hand if the node is in the segment 
corresponding to h\, then this heap does not correspond to any term in the 
sum /*3 • /12. In this case the * can first be replaced by 0, corresponding to the 
root of hj, and then replaced by the proper node from h\ when computing 
(^3 • /12) • h\. We have shown that the product is associative. | 

4 From expressions to orchards 

In this section we show how computational problems involving higher order 
derivations can be translated into problems involving orchards, by defining 
a map 

+ :K<Ei 9 ... t EM>-+ 0 {LH{E l 9 ... t E M )). 

We begin by defining <f> on monomials p £ K<E\ i ... t EM> of the form 

^7 m ' ’ * 

© *(£»,...,£ *.). 

h^LH m {E\ , . . . , Em) 

Next extend the map <f> to all of K <E\ , . . . , Em> by /f-linearity. Recall that 
*(«» E,„> denotes the labeled heap with node j labeled with E^ } . 

Lemma 4.1 


0 *'= © 0 attach(m,v) 

h'€H m venodes h 

where attach(m,v) is the heap which arises when the node with name m is 
attached to node v of a heap in H m - 1- 

Proof. Given a heap h 9 £ H mi we obtain a heap h £ H m -\ by removing 
the node labeled m. Since the heaps h £ i/ m - 1 distinct, so are the heaps 
we obtain by attaching the node labeled m to a node v of h. | 

Theorem 4.1 The map <j> is a K-algebra homomorphism . 


9 


Proof. Let 7 = (71, . . . ,7 mj ) and 6 = (61, ... , £ ma ) and define 
^7 = ' * * Eyi , E$ — Es mi • ■ • Eti - 

It is clear that 

<f>{Ey + E$) = <j>{E y) + <f>(Es). 

We need only prove that 

HEy-E s ) = 4 (Ej)^(E s ). 

We do this by induction on the length of the multi-index 7. If mi = 1 , 
the assertion follows from Lemma 4 . 1 . Assume the assertion is true for 
m = 1 , . . . , mi . We compute 

= ^(^7m, + i ) ' ^(^m, ' ’ ' ^Tl) ' <K E Sm 2 ’ ' * Es\) 

= ^(^m 1+I ) • HE-r mi ■ • • E yi E Smj ■ • • £fo) 

= $(E-i mi + l • • • ' ' ■ E$i) 

showing that the assertion holds for m = mi + 1. | 

5 From orchards to differential operators 

In this section we define a map 

rP : 0 (LH(E l ,. . . , Em)) — Diff(D, , . . . , D N ; R). 

We do this in several steps. 

Step 1. Let h £ LH m (Ei,.. . ,Em) and let k £ nodes h, and suppose that 
are the children of k. Fix /if, . . . ,/i/» with 

0 < /i/,...,/i/' < N 

and define 

Rh(k-,m,...,pii) = D w ---D Mt ,a^* if k is not the root 

= D m • • ■ D if k is the root . 

We abbreviate this to R(k). 
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Step 2. Define 


m= E «(">)•• «(i)s(o). 

A*1 * * • - * Mm 

Step 3. Extend ip to all 0(LH{E\ Em)) by if-linearity. 
Lemma 5.1 Suppose p € K<E\ , . . . , Em> and 

xO 7 ) € Diff[Di,...,Ds',R) 

is the corresponding derivation defined by the substitution 

N 

Ej = Y, a : D ^ a j € R, 

M=1 

TAen 

x(p)(o) = (V" ° ^(p))( a )- 

Proo£ We need only prove the lemma when p is a monomial. Let 

P ~ ' ‘ * 

We proceed by induction on m. In the case m = 1, 


and 




as required. 

Assume the lemma holds for m! = 1, . . . , m — 1. Then we claim that 

^m = l /i m _i=l Ml = l 

which is x(p)(a)j is equal to 

= ( E a 7 m D Mm)(V- 0 A(£? 71> ...,£ rm _ 1 ))(a) 

Mm=1 heLH m -i(Ei,...,EM) 
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= Ec^( E *(*(£,, Vi»x«) 

* lm ksLH m -i{Eu---,E\{) 

= E E C^(JMm-l)-«l(0)K«) 

Mm heLH m - l (E l ,...,E M ) 

= E E ..Jfc(0))(«) 

+ E E ^^(m-l)..(D Mm ^(0))(a) 

h'zLH m (E \ , . . . , Z?m) 

= v>W£t m •• ^))(«) 

Here /»' € LH m (E\, ..., Em) is obtained from /» € LH m -\{E \ , . . . , £** ) by 
attaching the node labeled m to each node u of ft', as in Lemma 3.1. | 

The map \}> from orchards to Diff(Dx , . . . , Dff, R ) is not injective. This is 
because the derivations Z), commute. We conclude this section by describing 
some elements of the kernel. This requires some additional notation. Let 
LT m {E\ , Em) denote the set of all trees consisting of m+ 1 nodes labeled 
with the symbols Ei, . . ., Em- As in § 3, let 

LT\E 1 ,...,Em)= U LT m (Ei,...,E M ) 

m> 0 

and let 0(LT(Ei } . . . , Em)) denote the correpsonding orchard. Let 
p : 0{LH(E x } ...,E m ))—> 0{LT[E \ y . . . , E M ))> 

denote the natural map which simply sends a labeled heap-ordered tree to 
the labeled tree obtained by ignoring the heap-ordering. 

Lemma 5.2 Let h,h f G LH m {E \^ . . , Em) be two labeled heaps with the 
property p(h) =: p{h!). Then xp(h) = 

Proof. We use the notation introduced at the beginning of the section and 
write 

rJ>(h(E^ v ...,E^ m )) = 
rl>{h\E v v ...,E rtm )) = 
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Recall that if a node k has children then 

= Dp | 

Observe that the heap names of the nodes simply provide dummy in- 
dicies — p for h and u\ } i/ m for h ! — which are used to write 
out the differential operators in Diff(Di , . . . , Dj^\ R) corresponding to the 
heaps h and A'. Therefore if the underlying labeled trees are the same, 
then the differential operators in Diff(Di , . . . , Dpt;R) will be equal; that is 
p(A) = p(h f ) implies 0(A) = 0(A ; ) as asserted. | 

6 Symmetries of orchards 

Let a 6 0(LH m (Ei t . . . , Em)) be an orchard on labeled heaps which are 
homogeneous of degree m. We say that a has a symmetry decomposition in 
case 

1. cr = ao+c j; 

2. p(a 0 ) rs 0. 

In this section, we prove our main theorem by showing how symmetry de- 
compositions can be used to reduce the operation counts of computations 
involving higher order derivations. 

Consider an expression involving higher order derivations p in K<E\, 

. . E\f>. The substitution (1) produces a differential operator x(p) in 
Diff (Dj, . . \ R). Because of the symmetry of the expression p and the 
commuting of the s, the naive computation of \{p) often involves some 
cancellation. It makes sense, therefore, to ask whether there is an algorithm 
to compute a differential operator L £ Diff(Di, . . . , Ds\ R)> which agrees 
with x(p) and which does not require the computation of terms which cancel 
in the end. We will show that this is the case under the assumption that 
there is a symmetry decomposition of the corresponding orchard. 

To state the theorem requires a final definition. If the orchard a can be 
written 

<r = 53 w here a(h) £ K, and h £ LH m (E\ Em), 

h 

then let \cr\ denote the number of heaps A such that the corresponding 
coefficient <r(h) is nonzero. 
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Theorem 6.1 Fir an expression p £ K <E \ } . . . , E\f> which ts homoge- 
neous of degree m and let 

<r = <j>(p) G 0{LH m (E \ } . . . , Em)) 

be the corresponding orchard . Let \{p) £ Diff[D \, . . . , Dff ] R) be the differ- 
ential operator obtained by the substitution 

N 

Ej = £ af € R, 1 <j<M. 

Assume f/iaf <r = <r$ + cr\ *5 a symmetry decomposition of <r and let L = 
i). Then (i) L involves 

\<ro\N m 

fewer occurrences of terms containing D\ } ... } Dn than does x(p) and ( ii ) 
the higher order derivations \{p) and L agree . 

Proof. All the work has already been done. Since 

(T = cro + <T\ 

is a symmetry decomposition, we have p{<ro) = 0. Hence by Lemma 5.2, 
ip(ao) = 0, and there will be |<r 0 | N m fewer occurrences of terms containing 
Di, . . . , Ds . By Lemma 5.1 x0>) and ^ agree. This proves the theorem. | 

Theorem 1.1 is an immediate corollary of this theorem. 


7 Example 

In this section we present a simple example of a computation of a third order 
derivation in terms of orchards. Fix three derivations 

N 

Ej = ^ a jDp> where a** € R } 1 < j < Af, j = 1,2,3. 

Consider a higher order derivation of the form 

p = E$ E2 E\ — £3 E\ E2 — £2 E\ £3 + E\ E2 £3 . 

The naive computation of x(p) requires computing 2AN 3 terms of the form 
described in Table 2. 
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No. of terms 

Form of terms 

~8fP 

12N 3 

4JV 3 

coeff. 

coeff. 

coeflf. 


Table 2: Naive computation of x(p)' 


No. of terms 

Form of terms 

~W' 3 

127V 3 

4N 3 

coeff. 

coeff. 

coeff. D M3 Z) M2 D Ml 


Table 3: Terms in the computation of x(p) which cancel. 


The orchard a = contains 24 labeled heaps, six for each of the four 
terms of p. For example, the six labeled heaps corresponding to the first 
term are given in Figure 2. The orchard a has the symmetry decomposition 
(Tq + <T\> where the labeled heaps corresponding to <T\ are given in Figure 3. 
The orchard <to therefore contains the remaining 18 labeled heaps of a. 
An example of the cancellation of labeled heaps is given in Figure 4. The 
differential operator L = is equal to 

E^A^XA^HAm - £°3 J (0„3 
-E°2 3 (AX a XAX 1 )A,+ E^ha^xa^jai 
+ E a 3 3 «2 (A, A, <' ) A, - E (A* A , a 2 ) A, , 


and contains 18N 3 fewer terms of the form indicated in Table 3 than does 
the naive computation of x(p). 
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Figure 2: The labeled heaps <j)(E$EiE\). 
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Figure 3: The labeled heaps of <r\. 
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Figure 4 : The term E3E1E2 contributes the first labeled heap and the term 
E1E2E3 contributes the second, which cancel. 
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